UNCLASSIFIED 


_ AD  NUMBER _ 

AD890841 

LIMITATION  CHANGES 
TO: 

Approved  for  public  release;  distribution  is 
unlimited. 


FROM: 

Distribution  authorized  to  U.S.  Gov't,  agencies 
only;  Test  and  Evaluation;  26  JAN  1972.  Other 
requests  shall  be  referred  to  Office  of  Naval 
Research,  875  North  Randolph  Street,  Arlington, 
VA  22203-1995. 


_ AUTHORITY 

ONR  ltr,  29  Aug  1973 


THIS  PAGE  IS  UNCLASSIFIED 


AD  890841 


ADL-73538-2 


TECHNICAL  REPORT  2 

J 


SOME  SEARCH  PROBLEMS  WITH  FALSE  CONTACTS 

] 


James  M.  Dobbie 


* 


>- 

Q_ 

O 

O 

LU 

CS  1 1 

Sswu 

CJL) 
C3  GL2 i 
<3C  *w'-^ 


Prepared  Fo L 

Naval  Analysis  Programs  (Code  462) 

Office  of  Naval  Research 

/?  7 

£  L'i'&r-  (■  a  I  c~—  7  •* 

/ 

Under  Contract  No. 

N00014-71-C-0313/ 


•  on1 7 ' 


Prepared  By 

Arthur  D.  Little,  Inc. 
Cambridge,  Massachusetts  02140 


January  1972 


\j 


\  n  ' 


JAN  23  197? 

iksiSlbD  u  £ 

-  B  • 


"REPRODUCTION  IN  WHOLE  OR  IN  PART  IS  PERMITTED  FOR 
ANY  PURFOSE  OF  THE  UNITED  STATES  GOVERNMENT." 


L 

5 


SOME  SEARCH  PROBLEMS  WITH  FALSE  CONTACTS* 
James  M.  Hobble 

Arthur  D.  Little,  Inc.,  Cambridge,  Mass. 


ABSTRACT 


Some  search  problems  are  described  and  discussed, 
starting  with  the  case  of  no  false  contacts,  to  pro¬ 
vide  a  foundation  for  the  development  of  a  search 
theory  in  the  presence  of  false  contacts.  Important 
properties  of  the  search  plan  are  defined  and  illus¬ 
trated  by  examples.  After  a  general  description  of 
false  contact  generators  and  alternative  actions 
that  may  be  used  when  contacts  are  made,  the  problem 
is  formulated  for  the  case  in  which  false  contacts 
are  generated  by  real  stationary  objects  that  are 
investigated  when  contacted.  It  is  shown  that  the 
formulation  and  solution  of  the  standard  optimiza¬ 
tion  functionals  are  contingent  on  the  number  of 
false  targets  found,  in  general,  and  possibly  on  the 
locations  and  times  of  contact  as  well.  The  optimi¬ 
zation  functional  is  difficult  to  write  and  more 
difficult  to  solve.  The  formulation  is  made  for  the 
expected-time  functional  when  the  number  of  false 
targets  is  limited  to  finite  values.  The  solution 
is  outlined  and  illustrated  with  an  example. 

If  the  region  being  searched  is  known  to  contain  exactly  one  target  and 
no  false  contacts  occur,  the  formulation  of  the  criterion  for  the  proba¬ 
bility  of  detection  with  a  given  effort,  or  for  the  expected  effort  (or 
time)  to  find  the  target,  is  an  easy  problem.  Also,  the  solution  is  not 
difficult.  If  the  region  contains  real  objects,  other  than  the  target, 
that  can  generate  false  contacts,  or  if  false  contacts  occur  from  random 
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fluctuations,  the  optimization  criterion  may  be  difficult  to  formulate 
and  very  difficult  to  solve.  We  demonstrate  this  fact  by  formulating 
the  criterion  for  a  class  of  false  contacts,  and  solving  the  optimization 
for  a  particular  example. 

The  first  serious  attempt  to  develop  a  theory  of  search  in  the  presence 
of  false  targets  is  that  of  Stone  and  Stanshine  [4].  They  assume  that 
false  contacts  are  generated  by  real  objects  that  can  be  marked,  when 
located  and  identified,  so  that  they  will  not  require  investigation 
should  they  be  contacted  again.  They  use  a  special  set  of  assumptions 
that  permits  the  expected-time  criterion  to  be  formulated  without  in¬ 
cluding  the  possibility  that  the  optimal  search  plan  may  depend  on  the 
number  of  false  targets  that  have  been  found  and  eliminated.  We  show 
that  the  optimal  search  plan  does  not  have  this  property,  in  general; 
and  that  the  expected-time  functional,  or  the  probability  functional, 
is  difficult  to  construct,  and  more  difficult  to  solve.  The  formulation 
and  solution  have  been  obtained  for  some  particular  cases,  and  a  method 
for  the  formulation  and  solution  has  been  outlined  for  other  cases.  The 
general  problem  remains  unsolved. 

Some  special  properties  of  the  optimal  solution  are  discussed  in  section  1, 
starting  with  the  case  of  no  false  contacts.  The  general  false  contact 
search  problem  is  discussed  in  section  2  and  the  problem  in  which  false 
contacts  are  generated  by  real  stationary  objects  is  discussed  in  sec¬ 
tion  3.  Conditional  detection  functions  and  posterior  false  target  dis¬ 
tributions  are  developed  in  sections  4  and  5.  After  a  discussion  of 
optimization  criteria  in  section  6,  the  problem  is  formulated  for  the 
expected-time  criterion  in  section  7  and  solved  for  a  simple  two-cell 
problem  in  section  8. 

1.  Additivity,  Consistency,  and  Contingencies 

We  start  with  a  discussion  of  some  properties  of  the  optimal  search  plan 
when  the  region  contains  one,  and  only  one,  target  and  no  false  contacts 
occur.  Koopman  [3,  p.  617]  describes  a  property  of  the  optimal  search 
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density  function  that  depends  on  the  optimization  criterion,  as  well  as 
the  conditional  detection  function.  It  states  that  the  optimal  search 
density  function  that  maximizes  the  probability  of  detecting  the  target 
with  a  given  total  effort  +  E^,  for  positive  E^  and  E  ,  is  the  sum  of 
the  optimal  density  function  for  and  the  conditionally  optimal  density 
function  for  F^,  applied  in  the  order  E^  followed  by  E^.  The  condition¬ 
ally  optimal  density  function  for  E ^  is  the  optimal  density  function  for 
E2>  given  that  the  target  has  not  been  found  with  the  previous  search 
effort  distributed  optimally.  If  the  optimal  search  density  function 
satisfies  this  condition  for  all  divisions  of  the  total  search  effort,  we 
say  that  it  is  additive,  or  that  it  has  the  additivity  property.  If  the 
optimal  search  density  function  is  additive,  we  can  apply  the  effort 
piecemeal,  optimizing  conditionally  for  each  piece,  and  the  total  effort 
will  be  optimally  distributed. 

The  optimal  search  density  function  usually  has  another  property  that 
sometimes  is  confused  with  the  additivity  property.  Suppose  that  the 
effort  E^  has  been  applied  unsuccessfully  according  to  the  plan  that  is 
optimal  for  the  effort  E^  +  E^  and  we  pause  to  replan  the  remainder  E^ 
of  the  search  effort.  If  the  optimal  search  plan  for  the  remainder  is 
the  same  as  it  is  in  the  original  search  plan  and  this  holds  for  all 
divisions  of  the  total  effort,  we  say  that  the  optimal  search  plan  is 
consistent,  or  that  it  has  the  consistency  property. 

As  the  search  proceeds,  various  events  may  occur  as  results  of  the  search, 
and  otherwise.  The  optimal  search  plan  may  depend  on  these  contingencies 
or  be  independent  of  them.  An  obvious  contingency  is  the  state  of  the 
target  detection.  Since  there  is  exactly  one  target  in  the  region  being 
searched,  we  assume  that  search  stops,  if  the  target  is  found.  Search 
continues  only  when  the  target  has  not  been  found  (and  perhaps  not  then). 
Thus,  the  continuation  of  search  is  contingent  on  the  target  not  being 
found.  If  the  search  plan  is  independent  of  all  contingencies  other  than 
the  state  of  target  detection,  we  say  that  it  is  contingent-free. 
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The  additivity,  consistency,  and  contingent-free  properties  are  not  iden¬ 
tical.  The  additivity  property  says  that  we  can't  improve  the  search 
plan  by  planning  the  distribution  of  the  entire  effort  at  the  start, 
rather  than  doing  it  piecemeal.  The  consistency  property  says  that,  if 
we  plan  optimally,  no  improvement  can  be  made  after  part  of  the  search 
has  been  made,  by  considering  the  results  of  the  searching  done  thus  far. 
The  contingent-free  property  says  that  the  only  contingency  that  we  need 
to  consider  in  planning  the  search  is  the  state  of  target  detection. 

If  the  contingencies  are  limited  to  the  state  of  target  detection  and  the 
region  is  known  to  contain  exactly  one  target  and  no  false  targets,  the 
consistency  property  is  a  consequence  of  optimality,  provided  the  optimal 
search  plan  is  followed  exactly  and  the  "pause"  is  conceptual  only.  When 
a  conceptual  pause  is  made  to  replan  the  search  the  only  available  infor¬ 
mation  is  that  the  target  has  not  been  found  with  the  effort  applied  thus 
far,  which  is  the  condition  assumed  to  hold  for  the  continuation  of  search. 
If  the  optimal  search  plan  has  been  followed  exactly,  as  assumed  in  plan¬ 
ning  the  search,  no  information  is  available  when  the  pause  is  made  that 
was  not  available  when  the  original  plan  was  constructed.  Hence,  if  the 
plan  is  optimal,  it  is  consistent,  under  these  conditions. 

Optimality  also  implies  consistency  when  we  admit  other  contingencies, 
provided  that  they  can  be  foreseen  and  included  in  the  search  plan.  For 
example,  if  the  region  contains  one  false  target  in  addition  to  the  one 
target,  the  optimal  search  plan  may  depend  on  the  state  of  detection  of 
the  false  target,  which  can  be  included  in  the  search  plan.  Thus,  the 
optimal  search  plan  is  consistent,  but  not  contingent-free,  in  this  case. 

The  optimal  search  plan  might  not  be  consistent  when  a  pause  of  positive 
duration  is  made.  For  example,  suppose  that  a  golfer,  while  looking  for 
a  lost  ball,  tramples  the  ground  and  hits  weeds  with  his  club  and  then 
sits  down  to  rest  and  plan  his  further  search.  If  he  doesn't  sit  too 
long,  the  position  of  the  ball  will  not  be  changed,  and  the  grounds  and 
weeds  will  be  in  essentially  the  same  state  when  he  resumes  searching 
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as  they  were  when  he  sat  down  to  rest.  However,  the  conditions  of  the 
grounds  and  weeds  could  be  altered  considerably  in  an  interval  of  days, 
by  partial  recovery  or  by  changes  of  the  type  produced  by  a  thunderstorm. 
Also,  in  a  long  interval  the  position  of  the  ball  could  be  changed  or  the 
ball  might  be  removed  from  the  region  entirely. 

We  avoid  these  difficulties  by  assuming  that  the  target  is  stationary  and 
the  conditional  detection  function  has  an  additive  property.  Let  m(x)  be 
the  search  density  at  a  point  x  of  the  region  R,  assumed  to  be  Euclidean 
n-space.  Assume  that  the  conditional  detection  function,  called  the  local 
effectiveness  function  by  Stone  and  Stanshine  [4],  is  a  function  b(m(x)) 
of  the  search  density  function  alone.  (We  could  assume  that  b  is  a  func¬ 
tion  of  x,  as  well,  but  the  gain  in  generality  is  slight.)  Thus,  b(m(x)) 
depends  only  on  the  total  density  m(x)  and  is  not  affected  by  the  passage 
of  time  during  which  no  searching  is  done.  We  assume  that  b(m)  has  the 
usual  properties  of  a  probability  function.  For  convenience,  we  also 
assume  that  it  has  a  derivative  that  is  positive,  continuous,  and  strictly 
decreasing. 


Assume  that  we  search  with  density  m^(x),  do  not  find  the  target,  and  then 
search  with  the  additional  density  m^Cx).  Let 

b(m2(x) In^Cx))  =  conditional  probability  of  detecting  a  target 
at  x  with  a  search  of  density  m2(x),  given 
that  it  was  not  detected  by  a  previous  search 
of  density  m^(x) 


By  conditional  probabilities  we  have 

b(m^(x)  +  m2(x))  =  b(m^(x))  +  [l-bCm^x))]  b(m2(x)  Im^x)) 

from  which  we  obtain  the  equation 

b  (m1 (x)+m2 (x) ) -b (m^  (x) ) 
b (m2 (x)  | m^ (x) ) - f-b^OO) 


(1) 
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Let  f(x)  be  the  density  function  for  the  target  in  the  region  R.  Then 
the  probability  of  detection  wlJi  the  search  density  function  m^(x)  fol¬ 
lowed  by  m2 (x)  is 

P(m1+m2)  =  /  f(x)b(m1(x)+m2(x) )dx  (2) 

R 

The  global  conditional  detection  function  P(m2|m^),  given  that  the  target 
was  not  detected  by  the  search  of  density  m^(x),  is  obtained  by  an  equa¬ 
tion  analogous  to  equation  (1)  for  the  local  conditional  detection  func¬ 
tion. 

Equation  (2)  shows  that  P(m)  is  an  additive  functional  of  m.  Put 
3 (m(x) )  =  l-b(m(x) ) ,  6 (n^ (x)  | (x) )  =  l-b(m2(x)  jm^x)) 

Then  equation  (1)  takes  the  simpler  form 

3(ir>2(x)  |m^(x))  =  3(m1(x)  +  m2  (x)  ) /3  (n^  (x) )  (1  ) 

/V 

We  say  that  3  is  additively  dependent  on  the  previous  searching  effort 

I 

when  equation  (1  )  holds. 

In  some  search  problems  a  contingency  may  occur  that  prevents  the  use  of 
equations  (1)  and  (2)  when  m^(x)  is  applied  before  the  contingency  occurs 
and  m2(x)  afterward.  For  example,  suppose  that  we  are  searching  for  an 
object  that  was  lost  in  the  sand  on  a  beach  that  is  exposed,  and  avail¬ 
able  to  be  searched,  only  at  low  tide.  The  effects  produced  by  digging 
and  sifting  are  undisturbed  while  the  tide  is  out,  but  are  undone  by  the 
next  high  tide.  The  conditional  detection  function  is  additive  for  the 
search  that  is  made  during  any  one  low  tide,  but  not  for  two  low  tides. 

If  we  assume  that  searches  of  densities  m^(x)  and  m2(x),  made  in  two  low 
tides  are  completely  independent,  equation  (2)  is  replaced  by 

P(m;L,  m£)  =  1- [  1-P (mi)  ]  [  1-P (m2 )  ]  (3) 

where  the  detection  probability  P  now  is  a  functional  of  the  two  density 
functions,  m^  and  m2> 
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A  different  equation  is  obtained  if  we  assume  that  the  target  location 
is  not  changed  by  the  action  of  the  high  tides,  that  we  can  locate  the 
density  m^(x)  relative  to  m^(x),  and  that  the  local  conditional  detec¬ 
tion  function  in  the  second  low  tide  is  the  same  as  that  in  the  first 
low  tide.  Then  equations  (1)  and  (2)  are  replaced  by 

b(m2(x)  Im^x))  =  b(m2(x))  (4) 

P^,  m2)  =  1  -  J  f  ( x)  [  1— b  (m^(x)>  }  [  1— b  (m2 (x)  )  ] dx  (5) 

R 

Here,  m^(x)  is  the  density  of  effort  during  the  first  low  tide  and  m2(x) 
is  the  density  of  effort  during  the  second  low  tide;  no  other  division  of 
m^(x)  +  m2(x)  can  be  used  in  equations  (4)  and  (5).  When  the  conditional 
detection  function  satisfies  equation  (4)  we  say  that  it  is  independent 
of  the  effort  in  the  previous  stages. 

Another  search  problem  of  this  type  is  that  of  an  integrating  detector 
that  recovers  rapidly  between  successive  '‘looks"  at  targets.  While  a 
target  is  in  the  beam  of  the  detector  the  signals  received  by  the  de¬ 
tector  are  additive;  the  response  of  the  detector  to  one  look  at  a  target 
depends  only  on  the  sum  of  the  signals  received  in  that  look.  However, 
the  conditional  probability  of  detecting  a  target  at  x  in  a  second  scan 
of  the  target  space  is  obtained  from  equation  (4),  assuming  complete 
recovery  of  the  detector.  The  probability  of  detection  in  two  scans  of 
the  sensor,  with  densities  m^(x)  and  m2(x),  is  obtained  from  equation  (5). 

Equations  (4)  and  (5)  were  assumed  by  J.  M.  Danskin  [1].  The  conditional 
detection  function  b(m)  is  additive  in  each  separate  stage  (low  tide  in 
the  beach  problem  and  scan  for  the  integrating  detector),  but  is  not 
additive  for  two  or  more  stages.  The  problem  of  maximizing  P(m^,  m2>  in 
equation  (5)  for  a  given  total  effort  is  not  essentially  different  from 
the  problem  of  maximizing  P(m)  when  it  satisfies  equation  (2).  If  the 
effort  is  specified  for  each  stage,  the  problem  can  be  solved  by  Dynamic 
Programming  or  by  a  method  devised  by  Danskin. 
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Although  the  optimal  search  plan  Is  not  contingent-free,  the  contingency 
for  the  beach  problem  and  for  the  integrating  detector  can  be  foreseen 
and  included  in  the  search  plan.  Again,  the  optimal  search  plan  is  con¬ 
sistent,  provided  it  is  followed  exactly. 

If  the  optimal  search  plan  is  not  followed  exactly,  we  may  be  able  to 
improve  the  search  plan  by  replanning  at  intervals,  provided  we  can 
determine  and  record  the  actual  search  density  that  has  been  applied. 

It  is  well  known  that  the  actual  effort  distribution  does  not  coincide 
with  the  planned  distribution,  and  sometimes  the  difference  is  large. 
Also,  it  often  is  difficult  to  determine  what  distribution  has  been  ap¬ 
plied,  and  to  make  provisions  for  recording  this  information  and  using 
it  in  replanning.  We  will  return  to  this  question  in  formulating  the 
false  target  problem. 

If  b(m)  is  the  negative  exponential  function,  b  in  equation  (1)  also  is 
the  negative  exponential  function,  and  equation  (4)  is  satisfied.  The 
negative  exponential  function  is  the  only  probability  function  with  this 
property.  For  this  conditional  detection  function  the  probability  func¬ 
tionals  (2)  and  (5)  are  identical.  DeGuenin  [2]  replaced  the  negative 
exponential  function  by  more  general  functions  that  are  additive  and 
hence  satisfy  equation  (1),  while  Danskin  [1]  generalized  by  assuming 
equation  (4). 

2.  The  False  Contact  Search  Problem 

We  start  with  a  general  discussion  of  false  contacts  and  problems  that 
are  produced  by  the  false  contacts,  before  restricting  the  discussion  to 
false  contacts  that  are  generated  by  real  stationary  objects. 

False  contacts  may  be  generated  by  real  objects  that  can't  be  distin¬ 
guished  from  the  target  with  certainty,  except  by  a  close  inspection. 

For  example,  in  search  by  active  sonar  for  a  submerged  submarine  some 
possible  generators  of  false  contacts  are  wrecks  on  the  bottom,  sea 
mounts  and  bottom  irregularities  that  reflect  sound  waves,  whales,  other 
marine  life,  and  decoys  (including  bubble  clouds  produced  by  the  inter¬ 
action  with  water  of  chemicals  expelled  from  the  target  submarine). 
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False  contacts  also  may  be  generated  by  anomalies  or  variations  (usually 
called  noise)  in  the  signal  response,  produced  by  fluctuations  in  the 
performance  of  the  detection  equipment  and  fluctuations  in  the  medium 
through  which  the  energy  passes. 

When  a  contact  is  made  the  searcher  may  decide  to  take  no  immediate 
action,  while  continuing  to  observe  the  contact  indication;  or,  decide 
to  stop  searching  and  investigate  the  contact;  or,  decide  to  proceed 
with  appropriate  action,  on  the  assumption  that  the  contact  is  the  tar¬ 
get.  If  no  immediate  action  is  taken,  the  searcher  may  decide  later  to 
investigate  the  contact  or  to  take  some  other  action.  Under  combat  con¬ 
ditions  it  may  not  be  feasible  to  investigate  the  contact;  the  searcher 
can  ignore  the  contact,  attempt  to  maintain  contact,  or  make  an  attack. 

As  the  search  proceeds  the  searcher  may  obtain  additional  information  on 
the  generators  of  false  contacts,  their  types,  numbers,  and  locations. 

Some  of  the  information  will  be  obtained  by  direct  observation  and  some 
of  it  by  deduction.  For  example,  the  number  and  locations  of  contacts, 
and  the  times  at  which  the  contacts  were  made,  can  be  observed  and  re¬ 
corded.  Also,  results  of  investigations,  if  made,  would  be  known.  In¬ 
ferences  can  be  made  about  the  number  and  location  of  false  targets  not 
contacted,  under  some  conditions,  from  the  observed  results. 

The  searcher  may  be  able  to  use  some  of  the  additional  information  in  the 
continuation  of  the  search.  In  general,  the  extent  to  which  he  can  do  so 
will  depend  on  the  contingencies  that  have  been  anticipated  and  provided 
for  in  the  search  plan,  and  the  availability  of  the  required  information. 
For  example,  the  searcher  may  be  using  a  search  plan  that  anticipates  the 
finding  of  real  objects  that  generate  false  contacts.  Each  time  such  an 
event  occurs  the  search  plan  may  change  in  a  way  that  requires  the  esti¬ 
mation  of  the  posterior  distribution  of  residual  false  targets.  The 
posterior  distribution  of  residual  false  targets  depends  on  the  distri¬ 
bution  of  effort  that  the  searcher  has  applied  up  to  that  epoch.  The 
applied  distribution  of  effort  almost  always  differs  from  the  planned 
distribution,  and  often  by  large  amounts.  Hence,  to  estimate  the  posterior 
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distribution  of  residual  false  targets  under  realistic  assumptions  it  is 
necessary  to  record  the  actual  distribution  of  search  effort.  If  no  pro¬ 
vision  is  made  for  the  collection  of  this  information  and  for  its  use  in 
computing  the  posterior  distribution,  a  different  search  plan  must  be 
used.  (In  this  connection  we  observe  that  a  search  plan  that  requires 
the  effort  to  be  distributed  in  time,  as  well  as  in  location,  would  re¬ 
quire  continuous  feedback  from  the  actual  search  distribution  to  the 
search  plan,  and  would  be  very  difficult  to  implement.) 

The  above  discussion  of  the  false  contact  search  problem  has  been  made 
to  provide  a  proper  perspective,  by  showing  the  complexity  of  the  general 
problem  before  turning  to  a  special  case.  False  contacts  may  be  generated 
by  real  objects  and  by  random  fluctuations.  Real  objects  may  be  station¬ 
ary  or  moving,  and  may  or  may  not  be  identifiable.  Various  action  options 
are  available  to  the  searcher  when  contacts  occur.  Additional  information 
that  becomes  available  as  the  search  proceeds  may  be  used  to  improve  the 
search  plan,  provided  the  search  plan  includes  the  relevant  contingencies. 
It  is  evident  that  a  mathematical  abstraction  that  includes  all  the  possi¬ 
bilities  would  be  very  complicated.  We  start  with  a  special  case  that 
illustrates  some  of  the  difficulties. 

3.  False  Contacts  Generated  by  Real  Stationary  Objects 
Stone  and  Stanshine  [4]  assume  that  false  contacts  are  generated  by  real 
objects  that  can  be  marked,  when  located  and  identified,  so  that  they 
will  not  require  investigation  should  they  be  contacted  again.  They  also 
assume  that  the  false  contacts  are  generated  as  an  inhomogeneous  Poisson 
process.  We  generalize  the  Stone-Stanshine  model  in  several  respects. 

We  assume  that  exactly  one  stationary  target  is  known  to  be  in  a  region 
R  of  Euclidean  n-space,  with  known  location  density  function  f(x).  During 
the  search,  false  contacts  may  be  generated  by  other  real  objects  in  R, 
called  false  targets,  which  can't  be  distinguished  from  the  target  except 
by  a  close  inspection.  The  number  of  false  targets  in  R  may  be  known,  or 
unknown  with  a  known  number  density  function.  We  assume  that  the  false 
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targets  are  independently  distributed  with  known  location  density  func¬ 
tions.  They  may  be  identically  distributed  with  common  location  density 
function  g(x),  or  otherwise.  Our  assumptions  are  more  general  than  those 
of  Stone  and  Stanshine,  who  explicitly  introduce  only  the  collective  loca¬ 
tion  density  function  6(x).  Other  properties  of  the  false  target  popula¬ 
tion  must  be  inferred  from  the  assumptions  on  false  contacts,  by  means  of 
which  one  can  deduce  that  their  number  density  function  for  false  targets 
is  the  Poisson  function. 

If  a  contact  is  made,  the  search  will  be  interrupted,  an  investigation 
will  be  started,  and  continued  until  the  contact  has  been  identified.  If 
the  contact  is  the  target,  the  search  will  be  stopped.  If  the  contact  is 
a  false  target,  its  location  will  be  recorded  and  the  position  marked, 
perhaps  with  a  buoy,  so  that  another  investigation  will  not  be  made, 
should  it  be  contacted  again.  Then  search  will  be  resumed. 

Under  these  conditions  the  optimal  search  plan  may  depend  on  the  number 
of  false  targets  that  have  been  found  and  eliminated,  since  the  distribu¬ 
tion  of  the  residual  (undetected)  false  targets  may  be  changed  as  false 
targets  are  found  and  eliminated.  Hence,  in  formulating  the  search  prob¬ 
lem  and  writing  the  expression  for  the  optimization  functional  we.  should 
include  the  number  of  found  false  targets  as  a  contingency,  unless  we  can 
demonstrate  In  advance  that  the  optimal  search  plan  is  independent  of  the 
number  of  found  false  targets. 

Stone  and  Stanshine  [4]  formulate  their  search  problem  and  write  an  equa¬ 
tion  for  the  expected  time  to  find  the  target  under  the  implicit  assump¬ 
tion  that  the  search  plan  does  not  depend  on  the  number  of  found  false 
targets.  They  solve  this  problem  and  then  undertake  to  prove  that  their 
solution  has  the  assumed  property.  We  question  the  validity  of  this 
argument.  The  expected-time  functional  when  the  search  plan  is  assumed 
to  be  contingent  on  the  number  of  found  false  targets  is  not  the  same  as 
(or  even  remotely  similar  to)  the  corresponding  functional  when  the  search 
plan  is  assumed  to  be  independent  of  the  contingency.  Hence  we  have  no 
assurance  that  we  are  optimizing  the  correct  functional  unless  we  can  show 
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in  advance  that  the  optimal  search  plan  is  independent  of  the  number  of 
found  false  targets.  For  the  special  conditions  assumed  by  Stone  and 
Stanshine  a  prior  proof  can  be  made,  as  shown  in  section  5  below. 

The  posterior  proof  given  by  Stone  and  Stanshine  is  incomplete.  In  sec¬ 
tion  4,  they  use  "additivity"  to  describe  the  properties  that  we  call 
"consistency"  and  "contingent-free".  They  state  that  the  optimal  plan 
is  to  continue  with  the  original  search  plan,  if  at  any  time  before  the 
target  has  been  found  it  is  decided  to  replan  the  search  to  minimize  the 
expected  time  remaining  to  find  the  target.  To  show  this  they  examine 
two  contingencies,  as  follows: 

(a)  No  contact  has  been  made, 

(b)  A  contact  has  been  made  and  not  investigated. 

But  these  contingencies  are  included  in  the  formulation  of  the  problem 
and  it  was  proved  in  section  3  of  their  paper  that  immediate  contact 
investigation  is  optimal.  If  it  were  possible  to  improve  the  search  plan 
under  contingencies  (a)  and  (b),  the  search  plan  would  not  be  optimal. 

On  the  other  hand,  they  fail  to  consider  the  contingency 

(c)  A  contact  has  been  made,  investigated,  and  found  to  be 
false. 

Since  this  contingency  was  not  included  in  the  original  formulation,  the 
search  plan  that  is  optimal  when  it  is  not  included  conceivably  could  be 
improved  by  including  it.  Only  for  the  overlooked  contingency  (c)  does 
optimality  not  imply  consistency. 

4.  Effort  Distributions  and  Conditional  Detection  Functions 

It  will  be  convenient  to  use  a  notation  that  permits  the  search  density 

function  to  change  each  time  a  false  target  is  found.  Let 

=  search  time  at  which  the  first  contact  is  made, 

y^(x,s)  =  search  density  at  x  by  search  time  s,  0  £  s  £  s^. 
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If  the  contact  is  a  false  target  and  search  is  resumed,  let 


82  *  additional  search  time  in  the  second  stage,  measured 

from  the  resumption  of  search  until  a  second  contact 
is  made, 

^(x.s)  =  additional  search  density  at  x  by  the  additional 
search  time  s  in  the  second  stage,  0  £  s  <_  S2* 

In  general,  let 

s^  =  additional  search  time  to  make  a  contact  in  the  i^ 

stage  of  the  search, 

p  (x,s)  =  additional  search  density  at  x  by  the  additional 
1  th 

search  time  s  in  the  i  stage,  0  <  s  _<  s^. 

We  assume  that  y^x.O)  =  0  and  that  p^x.s)  is  nondecreasing  in  s  for 
each  i  and  for  every  x  in  R.  The  total  effort  density  at  x  in  the  first 
j  stages  is 

m.  (x)  =  Y]p,(x,s  )  (6) 

J  i= 1  1  1 

At  additional  search  time  s  in  the  j*"*1  stage,  after  (j  -  1)  false  tar¬ 
gets  have  been  found,  the  total  search  density  at  x  is 

nij  (x, s)  =  M  (x)  +  Pj(x,s)  (7) 

We  call  attention  to  the  fact  that  M.  (x)  =  m.(x,s.)  in  our  notation. 

J  J  J 

Thus,  capital  M  is  used  for  the  value  of  m  when  contact  occurs.  The 
variable  s  is  used  for  the  additional  search  time;  the  total  search 
time  S  corresponding  to  the  additional  search  time  s  in  the  jth  stage 
is  S  =  s^  +  S2  +  • • •  +  sj_i  +  s' 

The  total  effort  that  has  been  applied  in  the  additional  search  time  s 
in  the  j ^  stage  is 

w  (s)  =  f  p.(x,s)  dx 
J  R  J 
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and  the  total  effort  (S)  from  the  start  of  search  is 

t,1  J"1 

w, (S)  -  w  (s)  +  £  w.  (s.)  .  s  -  s  +  s 
J  J  i-1  i-1  1 


Then  we  can  impose  the  condition  that  the  effort  in  the  j 
the  total  effort,  is  a  known  function  of  the  search  time, 
the  condition  that  effort  is  applied  at  a  constant  rate  U 
stage  is 


th 


j 


stage,  or 
For  example 
in  the  j1'*1 


9 


wj<s>  '  s  “j 


(8) 


We  assume  that  the  conditional  probability  that  a  target  at  x  will  be 
contacted  when  an  effort  of  total  density  m(x)  is  applied  at  x  is  a 
function  b(m(x)),  called  the  local  effectiveness  function  by  Stone  and 
Stanshine,  of  the  total  density  m(x) ,  however  it  is  applied.  We  assume 
that  b(0)  =  0,  lim  b(u)  =  1  as  u  ->  °°,  and  that  the  derivative  b'(u)  is 
positive,  continuous,  and  strictly  decreasing.  Some  of  these  properties 
can  be  relaxed  or  omitted  under  some  conditions. 


th 

We  obtain  the  conditional  contact  function  at  x  for  the  j  stage,  given 
that  the  effort  of  density  ^(x)  was  applied  in  the  first  j  -  1  stages, 
by  using  our  assumption  that  b  is  a  function  of  the  total  density.  Let 


bj(x,s)  =  b(iij(x,s)|Mj  ^(x))  =  conditional  probability  that  a 

target  at  x  will  be  contacted  by  the  additional  effort 
of  density  y^(x,s)  in  the  stage,  given  that  it 
hasn't  been  contacted  by  the  effort  of  density  M^_^(x) 
that  has  been  applied  in  the  previous  stages. 


Put 


1  -  b(m(x,s)) ,  B^(x,s)  =  1  -  b j  (x,s) 

I 


0(m(x,s) ) 

By  the  argument  used  to  obtain  equations  (1)  and  (1  )  we  have 


(x,s) 


epijCx.sj+M^Cx)) 


fKMj^x)) 


(9) 
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Let  a(u)  be  the  conditional  contact  failure  function  for  false  targets. 


corresponding  to  8(u)  for  the  target, 
failure  probability  otj(x,s)  in  the  jt'1 
equation 


Then  the  conditional  contact 
stage  is  obtained  from  the 


oij  (x,s) 


a(y  (x,s)+M  ^(x)) 


a(Mj_1(x)) 


5.  Posterior  False  Target  Distributions 

We  assume,  at  the  start,  that  the  search  effort  distribution  is  known 
exactly.  Also,  we  assume  that  the  false  targets  are  independently  dis¬ 
tributed  in  R,  and  we  restrict  attention  to  the  case  in  which  they  are 
identically  distributed  with  known  location  density  function  g(x)  and 
known  number  density  function  p(n).  We  want  to  find  the  posterior  loca¬ 
tion  density  function  g  (x,s)  and  the  posterior  number  density  function 

J  th 

Pj(n,s)  at  the  time  s  after  the  start  of  search  in  the  j  stage,  given 
that  j-1  false  targets  have  been  found  and  eliminated. 


Under  the  assumed  conditions  we  can  obtain  the  posterior  location  and 
number  density  functions  by  the  direct  application  of  conditional  prob¬ 
abilities,  sometimes  referred  to  as  Bayes'  theorem.  We  could  do  this 
for  the  j  stage  directly.  However,  we  prefer  to  proceed  step  by  step 
from  the  start  of  search  in  the  first  stage  to  the  start  of  search  in 
the  second  stage,  to  see  how  the  distributions  change  as  information 
becomes  available.  By  repeating  the  argument  we  can  obtain  the  distri¬ 
butions  for  any  desired  stage. 


In  the  first  stage  the  probability  that  a  false  target  chosen  at  random 
is  not  contacted  in  search  time  s  is 

Q  (s)  -  /  g(x)a(y. (x,s))  dx  (11) 

R 

for  0  <  s  £  s^.  The  posterior  location  density  function  for  false 
targets  is 

g^x.s)  =  g(x)a(y1(x,s))/Q1(s)  (12) 
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and  the  posterior  number  density  function  is 

00 

p.(n,s)  =*  p(n)Q^  (s)/  £  p(i)Q|'  (s)  ,  n  =  0,  1,  2,  ...  (13) 

i-0 

by  the  direct  application  of  conditional  probabilities. 

Assume  that  a  contact  is  made  at  location  x^  and  search  epoch  s^,  in¬ 
vestigated,  and  found  to  be  false.  This  event  has  no  effect  on  the 
location  distribution  of  the  unlocated  false  targets,  since  they  are 
assumed  to  be  independently  and  identically  distributed;  their  location 
density  function  is  g^(x,s^)  at  the  start  of  search  in  the  second  stage. 

However,  the  event  may  have  an  effect  on  the  number  distribution.  Define 
the  event  A  to  be 

Event  A:  a  false  target  is  at  x^  and  is  contacted  at  search 
epoch  s^;  no  other  contacts  are  made  in  search 
time  s^. 

Let 

P{ a|  n+1)  =  probability  of  event  A,  given  that  there  were 
n+1  false  targets  initially  in  R 

To  obtain  the  probability  that  a  false  target  is  "at  x^"  and  is  con¬ 
tacted  "at  search  epoch  s^",  we  need  to  define  the  terms  in  quotation 
marks.  We  say  that  a  false  target  is  at  x^,  if  it  is  in  an  arbitrarily 
small  interval  dx  centered  at  x^;  and  that  it  is  contacted  at  epoch  s^, 
if  it  is  not  contacted  in  search  time  s^  and  is  contacted  in  the  arbi¬ 
trarily  small  interval  (s  ,  s^  +  ds) .  Then,  to  first  order  terms  in  dx  and  ds, 

P{A| n+1)  -  [(n+l)g(Xl)dxj  ^(s^aC^Cx^))]  ^(y^x^s^-o^x^+ds)^  (14) 

The  first  quantity  in  square  brackets  is  the  probability  that  a  false 
target  is  at  x  ,  the  second  is  the  probability  that  none  of  the  n+1 
false  targets  is  contacted  in  the  search  time  s^,  and  the  third  is  the 
probability  that  the  false  target  at  x^  is  contacted  in  the  interval 
(s^j  s1  +  ds) . 
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The  probability  that  there  are  n  residual  false  targets  in  R  ut  the 
start  of  search  in  the  second  stage,  given  that  one  has  been  contacted 
at  at  epoch  and  eliminated,  is 

00 

p  (n,0)  =  p(n+l)  P { A | n+1 }  /  E  p(i+l)  P{A|i+l}  , 

L  i-0 

from  which  we  obtain 

00 

p  (n,0)  =  (n+1) p (n+1)  q"  (s  )/  E  (i+l)p(i+l)Q*  (sj,  n  =  0,1,2,... 
Z  1  1  i-0 

We  have  divided  numerator  and  denominator  by  common  factors. 

We  now  have  completed  one  cycle,  and  can  repeat  the  above  argument  to 

A  A 

get  g2(x,s)  and  p2(n,s).  The  location  density  function  of  unlocated 
false  targets  at  the  start  of  search  in  the  second  stage  is 

A  A 

g2(x,0)  =  g1(x,s1)  ,  (16) 

which  can  be  obtained  by  putting  s  =  s^  in  equation  (12).  Using  condi¬ 
tional  probability  arguments  we  obtain 

g2(x,s)  =  g2(x,0)  a2(x,s)/  Q2(s)  ,  (17) 

A 

where  a2(x,s)  is  obtained  from  equation  (10)  and 

Q2(s)  =  J"R  g2(x,0)  «2(x,s)dx  =  Q2(s)/Q1(s1)  ,  (18) 

Q2(s)  =  J*R  g(x)a(y1(x,s1)  +  p2(x,s))  dx  (19) 

The  second  equality  in  (18)  is  obtained  from  equations  (10),  (12),  and 
(16).  Substituting  from  equations  (16),  (10),  and  (18)  we  obtain  from 
equation  (17)  the  posterior  location  density  function 

g2(x,s)  -  g(x)a(y1(x,s1)  +  y2(x, s) )/Q2 (s)  (20) 


Similarly,  the  posterior  number  density  function  at  additional  search 
time  s  in  the  second  stage  is 

P2(n,s)  =  P2(n,0)  [q2(s)  ]  /  E  P2(i>°)  [q2(8)  ] 
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Using  equations  (15)  and  (18)  we  obtain 


00 

P,(n,s)  -  (n+l)p(n+l)  <£(s)/  E  (i+l)p(i+l)Q*(s) ,  n  -  0,1,2,...  (21) 


By  induction  we  obtain  the  location  and  number  density  functions  for  the 
j stage,  given  that  j-1  false  targets  have  been  found  and  eliminated. 
The  location  density  is 

gj(x,s)  =  g(x)a(m  (x,s))/Q  (s)  (22) 

and  the  number  probability  density  is 

Pj  (n,s)  =  (n+l)(n+2)...(n+j-l)p(n+j-l)Q"(s)/Ej(s),  n-0,1,2,...  (23) 


where 


Q. (s)  =  f  g(x)a(m  (x,s))  dx 
J  K  J 


00 

V  (a)  -  E  (i+1)  (i+2)  . . .  (i+j-l)p(i+j-l)Qj  (s) 
i-0  J 


The  location  density  function  g^(x,s)  depends  on  j  in  a  superficial  way, 
since  j  is  involved  only  in  the  total  effort  density  function  m^(x,s) 
that  has  been  applied.  The  same  location  density  function  would  be  ob¬ 
tained  for  a  given  total  effort  density  function,  regardless  of  the 
number  of  stages  and  the  distribution  of  effort  among  stages.  However, 
Pj(n,s)  in  equation  (23)  depends  on  j  in  a  fundamental  way,  in  general. 
An  exception  is  that  in  which  p(n)  is  a  Poisson  function, 

p(n)  =  e  N  /n  . 

having  expected  value  N,  say.  Then  Pj(n,s)  in  equation  (23)  reduces  to 

-NQ  (s)r-  -in 

Pj(n,s)  =  e  J  j^NQj  (s)J  /n  I  , 

the  Poisson  density  function  with  expected  value  NQ^(s).  Here,  again, 
j  is  involved  in  a  superficial  way. 
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If  pj(n,s)  depends  on  j  only  with  respect  to  the  total  effort  density 
function  nij(x,s),  it  is  not  necessary  to  change  the  search  plan  each 
time  a  false  target  is  found  and  eliminated.  The  Poisson  density  func¬ 
tion  has  this  property.  It  is  the  function  assumed  (implicitly)  by 
Stone  and  Stanshine  [4].  Are  there  other  density  functions  that  have 
this  property? 

Equations  (22)  and  (23)  apply  when  the  false  targets  are  independently 
and  identically  distributed,  with  known  location  density  function  g(x), 
and  known  number  probability  density  function  p(n);  and  we  search  with 
known  search  density  function  m^tx.s),  and  known  local  effectiveness 
function  a(m)  =  1  -  a(m).  Important  search  problems  occur  for  which  at 
least  one  of  these  assumptions  is  not  valid. 


For  example, 
rately  locat« 
not  accurate] 
not  independt 
The  location 
of  the  other 
locate  the  ol 


suppose  that  the  false  targets  are  wrecks  that  are  accu- 
:d  in  earth  coordinates,  while  the  searcher's  position  is 
y  known  in  earth  coordinates.  Then  the  false  targets  are 
ntly  (or  identically)  distributed  relative  to  the  searcher, 
of  a  found  false  target  yields  information  on  the  location 
false  targets,  and  this  information  may  be  sufficient  to 
her  false  targets  with  an  accuracy  that  would  permit  them 


to  be  avoidec  in  further  search. 

The  region  R  may  contain  several  classes  of  false  targets,  such  as  wrecks 
and  bottom  irregularities.  If  the  investigation  is  sufficient  to  deter¬ 
mine  the  class  to  which  the  false  target  belongs,  as  well  as  the  fact 
that  it  is  not  the  target,  we  can  treat  each  class  separately.  If  the 
investigation  only  establishes  the  fact  that  the  contact  is  not  the 
target,  the  formulation  is  more  complicated;  we  need  to  estimate  the 
probabilities  that  the  false  target  belongs  to  the  various  classes  from 
the  collective  class  densities  at  the  location  and  time  of  contact. 


Equations  (22)  and  (23)  for  the  location  density  function  and  the  number 
probability  density  function  require  that  we  know  the  search  density 
nij(x,s)  that  has  been  applied.  In  many  search  problems  it  is  difficult 
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to  determine  nij(x,s)  accurately,  even  when  provision  is  made  for  the 

recording  of  the  tracks  of  the  searchers.  If  m^(x,s)  is  not  known,  we 

can’t  apply  the  Bayesian  arguments  used  to  get  equations  (22)  and  (23). 

Even  when  provision  is  made  to  record  the  tracks  of  the  searchers,  there 

may  be  a  large  uncertainty  about  nc(x,s),  which  then  should  be  treated 

as  a  stochastic,  rather  than  a  fixed,  function.  Usually  we  assume  that 

m.(x,s)  is  equal  to  the  planned  density  m  (x,s),  without  any  means  of 
3  J 

measuring  and  recording  the  actual  distribution. 


If  the  uncertainty  in  m^(x,s)  can  be  expressed  in  the  form  of  a  density 

function  for  one  or  several  parameters,  an  argument  similar  to  the  one 

used  to  derive  equations  (22)  and  (23)  perhaps  could  be  made  to  obtain 

replacements  for  these  equations.  If  no  record  of  mj(x,s)  is  kept, 

there  appears  to  be  no  reasonable  alternative  to  the  use  of  equations 

* 

(22)  and  (23)  with  the  planned  density  m^(x,s). 


6.  Optimization  Criteria 

It  usually  is  assumed  that  the  general  objective  of  the  search  is  to 
find  the  target  quickly.  Two  precise  criteria  that  are  obtained  from 
this  general  objective  are: 

(1)  To  maximize  the  probability  P(t)  of  finding  the  target 
by  a  given  elapsed  time  t; 

(2)  To  minimize  the  expected  time  to  find  the  target. 

An  objection  that  can  be  raised  to  the  second  criterion  is  that  it 
assumes  implicitly  that  search  will  be  continued  until  the  target  is 
found,  a  condition  that  the  searcher  will  not  always  adhere  to  in  prac¬ 
tice,  even  when  he  accepts  it  as  a  condition  in  planning  the  search. 
Also,  there  is  a  possibility  that  our  assumption  that  there  is  a  target 
in  R  is  not  valid. 


When  no  false  targets  are  present  we  can  reconcile  the  two  criteria. 
If  a  search  plan  exists  that  maximizes  P(t)  for  all  t,  it  minimizes 
the  expected  time  to  find  the  target.  Such  a  plan  exists  when  no 
false  targets  are  present.  Of  course,  it  is  much  more  difficult  to 
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lay  out  a  practical  search  plan  that  approximates  the  distribution  of 
the  ideal  solution  when  trying  to  maximize  P(t)  for  all  t  than  when  try¬ 
ing  to  maximize  P(t)  for  a  single  value  of  t. 

When  false  targets  are  present  we  have  no  assurance  that  a  plan  exists 
that  maximizes  P(t)  for  all  t.  In  section  5  of  their  paper  [4]  Stone 
and  Stanshine  exhibit  an  example  for  which  the  search  plan  that  maximizes 
P(t)  for  a  particular  value  of  t  does  not  coincide  with  the  search  plan 
that  minimizes  their  integral  p(m)  for  the  expected  time,  from  which  they 
conclude  that  no  plan  maximizes  P(t)  for  all  t,  since  such  a  plan  must 
coincide  with  the  plan  that  minimizes  the  expected  time.  However,  they 
do  not  write  an  equation  for  P(t)  or  for  the  expected-time  functional, 
say  t(m),  that  is  obtained  from  P(t).  To  complete  the  argument  it  is 
necessary  to  prove  that  t(m)  =  u(m)  for  all  m,  since  these  two  func¬ 
tionals  are  derived  by  quite  different  arguments  and  do  not  appear  to 
be  identical.  A  proof  that  is  simple,  Kit  not  obvious,  can  be  made. 

The  optimization  functional  is  difficult  to  write  for  both  criteria  when 
false  targets  are  present.  In  the  next  section  we  show  how  to  construct 
the  expected-time  functional  when  the  number  of  false  targets  is  a  known 
finite  number  n,  and  we  outline  an  optimization  procedure.  An  obvious 
modification  of  the  procedure  can  be  used  when  the  number  is  not  known 
but  has  a  density  function  p(n)  that  is  restricted  o  finite  values, 
that  is,  there  exists  a  K  such  that  p(n)  =  0,  n  >  K.  The  problem  has 
not  been  solved  for  non-finite  distributions. 

We  also  have  examined  the  formulation  for  criterion  (1),  that  of  maxi¬ 
mizing  the  probability  of  detection  by  a  given  time.  The  problem  appears 
to  be  as  difficult  as,  and  perhaps  more  difficult  than,  the  problem  for 
criterion  (2),  which  is  a  better  reason  for  starting  with  the  expected¬ 
time  criterion  than  the  fact  that  no  plan  maximizes  P(t)  for  all  t. 

7.  Expected-Time  Criterion 

We  start  with  the  expected-time  criterion  (2).  Our  search  procedure  is 
as  follows: 
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a.  Search  until  a  contact  occurs,  investigate  the  contact 
until  it  is  identified. 

b.  If  the  contact  is  the  target,  stop  the  search. 

c.  If  the  contact  is  a  false  target,  record  the  location 
and  mark  the  site  so  that  investigation  will  not  be 
repeated,  should  this  false  target  be  contacted  again. 
Increase  the  number  of  found  false  targets  by  1  and 
use  the  fact  that  a  false  target  has  been  found  and 
eliminated  to  adjust  the  number  probability  density  of 
residual  false  targets  and  the  location  distributions 
of  residual  false  targets,  to  the  extent  possible. 

Then  continue  the  search. 

d.  Repeat  the  above  steps  until  the  target  is  found. 


If  the  initial  number  n  of  false  targets  is  known,  the  number  of  resid¬ 
ual  false  targets  in  the  j1*1  stage  is  n  -  j  +  1.  Let 

Sj  =  additional  search  time  in  the  jth  stage  at  which  contact 
is  made  in  that  stage; 


I. 

J 


time  to  investigate  the  j1"*1  contact,  if  false; 

th 

conditional  probability  that  the  j  contact  is 
false,  given  that  a  contact  has  occurred  at  x 


in  the  jth  stage. 


j 


Then  the  time  t  to  contact  the  target  is 
c 


'c  ■  S1  *  ’l(Il  +  s2  +  ’2(I2  +  S3  +  «3<  —  +  V:„  +  (26) 


Let 


Tn+1  “  Sn+1 


s  +  q  (I  +  T  . ) 
n  n  n  n+1 


T  =  s 
n-1 


.  +  q  .  (I  ,  +  T  ) 
n-1  nn-l  n-1  n 


(27) 


S1  +  «1(I1  +  V 
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Then  and  the  elapsed  time  t  to  find  the  target  is  t  ■  t  +  I, 

where  I  is  the  time  to  investigate  the  contact  that  is  the  target. 


The  expected  time  to  find  the  target  is  t  =  t  +1.  Since  I  is  indepen- 

c 

dent  of  the  search  plan,  we  minimize  t  .  The  expected  time  t  to  contact 

c  c 

the  target  is  obtained  by  averaging  stage  by  stage  in  equations  (27), 

s  t 

starting  with  the  (n+1)  stage  and  moving  (backwards)  to  the  first  stage. 


s  t 

In  the  (n+1)  stage  there  are  no  false  targets. 

s  t 

the  start  of  search  in  the  (n+1)  stage  is 


Wx> 


f(x)B(M  (x)) 


The  density  function  at 


(28) 


where  M  (x)  is  obtained  from  equation  (6)  and 


Q  -  f (x)8(M  (x))  dx 


(29) 


We  now  find  the  function  p  .,(x,s)  that  minimizes  the  expected  value  of 

n+1  * 

s  ,  which  is  a  solved  problem.  The  optimal  function  p  .(x,s)  is  the 
n+1  n*ri 

function  p  , 
n+J 

all  s,  where 


function  pn+^(x,s)  that  minimizes  the  failure  probability  Qn+^(s)  f°r 


;i+l 


(s)  =  Q'1  J*Rf (x)6(pn+1(x,s)  +  Mn(x))  dx 


(30) 


Let  Q  ,(s)  be  the  function  Q  , . (s)  when  p  has  been  replaced  by  the 
n+1  A  n+i  n+i 


optimal  function  pn+^,  and  Put 


n+1 


CO 

fo*, 


n+1 


(s)  ds 


(31) 


Then  T  ..  is  the  minimum  expected  time  to  contact  the  target  in  the 
n+1  ^ 

(n+l)st  stage.  From  equations  (6)  and  (30)  it  is  seen  that  T  may 

n+1 

depend  on  the  previous  density  functions  pj(x,s)  and  the  times  Sj  at 
which  previous  contacts  were  made,  j  *  1,  2,  ...  ,  n. 

In  the  nth  stage  we  minimize  the  expected  time  remaining  to  contact  the 

8 1 

target,  on  the  assumption  that  the  search  procedure  in  the  (n+1)  stage 
will  be  optimal.  Hence,  we  minimize  the  expected  value  of 
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f 


s  +  q  (I  +  T  .)=T(s,y) 
n  ^n  n  n+1  o  n  n 


That  is,  we  find  the  function  y  (x,s)  that  minimizes  T  (s  ,  y  )  over  s  , 

n  n  n  n  n 

given  that  there  is  one  false  target  and  one  real  target  in  R.  The  ex¬ 
pected  value  is  computed  over  the  probability  distribution  of  the  false 
contact  time  s^,  noting  that  and  T^^  (and  possibly  1^)  depend  on 

s  and  y  ,  in  general.  This  is  not  a  solved  problem.  We  have  solved  it 
n  n 

in  special  cases  used  as  examples,  one  of  which  will  be  shown  later. 


Assume  that  the  above  problem  has  been  solved  and  let  T  be  the  minimum 

n  st 

value  of  the  expected  value  of  T  (s  ,  y  ) .  Then  in  the  (n-1)  stage  we 

n  n  n 

minimize  the  expected  value  of 

Vl  +  Vl(I„-l  +  V  5  Vl<Vl'  "n-11  <33> 

This  problem  is  similar  to  the  optimization  problem  in  the  previous  stage, 

except  that  there  now  are  two  false  targets.  Also,  the  functional  form  of 
*  * 

T^  is  more  complicated  than  that  of  Tn+^* 

* 

Continuing  in  the  way  outlined  above  we  find  the  functions  y  -(x.s), 
it  it  n+1 

y  (x,s)  ...  ,  y.(x,s),  which  constitute  the  optimal  solution,  in  the  sense 
n  l 

of  minimizing  the  expected  time  to  find  the  target  when  all  the  available 

information  is  used.  The  function  y  (x,s)  in  the  j  stage  may  depend  on 
*  *  *  J 

the  functions  y^,  y^,  ...  ,  a°d  t'ie  contact  times  s^,  s^,  ...  ,  sj_^ 

in  the  previous  stages.  These  functions  and  times  will  be  known  when 

th  * 

search  is  resumed  in  the  j  stage.  The  optimal  function  y  (x,s)  in  the 

th  ^ 

j  stage  is  found  under  the  assumption  that  search  in  the  later  stages 

will  be  optimal. 

If  the  initial  number  n  of  false  targets  is  not  known  but  has  a  finite 

distribution,  we  can  apply  a  similar  procedure  to  find  the  solution.  If 

s  t 

the  maximum  value  of  n  is  K,  there  are  no  false  targets  in  the  (K+l) 
stage.  In  the  Kth  stage  the  possible  number  n^  of  residual  false  targets 
is  0  or  1.  If  n^  ■  0,  qR  =  0  and  there  are  no  later  stages.  If  ■  1, 
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i  i  iTirtiii  - - 


-ysfijpi 


the  problem  is  the  same  as  the  problem  when  n  is  known.  We  find  the  ex¬ 
pected  value  of  T (s  ,  p  )  over  the  distribution  of  n  before  proceeding 
K  K  K  K 

with  the  optimization;  similarly  for  the  other  stages.  Thus,  in  prin¬ 
ciple,  we  can  find  the  optimal  solution  in  (K+l)  steps  by  applying  the 
general  principle  of  Dynamic  Programming. 

If  the  distribution  of  n  is  not  finite,  the  problem  is  more  difficult. 

There  now  is  no  convenient  starting  place.  We  do  not  know  how  to  solve 
this  problem. 

8.  Solution  For  a  Particular  Problem 

We  find  the  solution  for  a  simple  example  to  show  the  general  procedure 

that  is  used  in  minimizing  T  (p  ,  s  ).  Assume  that  R  consists  of  two  dis- 

n  n  n 

joint  regions  I  and  II  in  the  plane,  each  having  Lebesque  measure  1;  the 
target  density  function  is  f(x)  =  f  for  x  in  I,  f(x)  =  1  -  f^  for  x  in 
II;  and  there  is  one  false  target,  known  to  be  in  region  II.  Assume  that 
the  time  required  to  identify  a  contact  is  1,  that  the  conditional  detec¬ 
tion  function  is  b(z)  =  1  -  exp(-z)  for  the  target  and  false  target,  and 

that  effort  is  applied  at  a  constant  rate  U  ■  1. 

We  search  with  density  function  p^(x,s)  until  a  contact  is  made  at  s  =  s^. 

If  the  contact  is  the  false  target,  we  go  to  the  second  stage  of  the  search 

and  search  with  density  function  p2(x,s),  knowing  there  are  no  false  tar¬ 
gets  remaining.  At  the  start  of  the  second  stage  the  conditional  target 
density  function  has  the  form 

f2(x)  *  f2  for  x  in  I,  f2(x)  -  1  -  f2  for  x  in  II 

where  f2  is  independent  of  x,  but  depends  on  p^  and  s^.  (We  can  obtain 
f2  from  equation  (28)  when  needed.) 

The  search  density  function  p*(x,s)  that  minimizes  the  expected  additional 

time  s  to  contact  the  target  depends  on  the  magnitude  of  f2«  If  f2  ^  0.5, 
*  * 

P2  has  the  form: 
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k 

For  0  <  s  <  Sq ,  u2(x,s) 


k 

For  s  >  sQ,  y2(x,s) 


0  for  x  in  I 

s  for  x  in  II 

(s  -  Sq)/2  for  x  in  I 

(s  +  Sq)/2  for  x  in  II 


where 


s0  »  ln(f21-l) 


From  equation  (30)  Q2(s)  for  the  optimal  distribution  is 


Q*(s) 


f2  +  (l-f2)e 


-s 


•  S  1  Sq 


,,,1/2,  ,  .1/2  -s/2 

2f2  (1"f2)  e  >  s  s0 


Then 

00 

T2  *  /o  Q2(s)ds  ‘  1  +  f2<2  +  so) 

(If  needed,  we  can  get  T*  when  f2  >  0.5  by  replacing  f2  by  1  -  f2 
above  expression.) 


Write  y^(x,s)  in  the  form 

|  y(s)  for  x  in  I 


y1(x,s)  - 
From  equation  (28), 


l  s-y(s)  for  x  in  II 
f2  becomes 


where  s^ 


-y(s.) 

f2  *  /Q1(s1,  y(sx)) 

is  the  observed  time  at  which  the  first  contact  was  made 
Q1(s,y)  «  fie~V  +  (!  "  S+Y 


in  the 


and 

(34) 
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Then 


sQ  -  2y(s1)  -  sx  +  In  (f”1— 1) 

* 

and  we  now  can  write  T ^  in  terms  of  s^  and  y(s^). 

To  write  the  equation  for  T^  in  equation  (32)  we  need  the  conditional 
probability  q^  that  the  first  contact  is  made  on  the  false  target,  given 
that  the  contact  is  made  at  search  time  s^.  The  probability  that  the 
false  target,  known  to  be  in  region  II,  will  not  be  contacted  by  search 
time  s  is 

Qp(s,y)  «  e-s+y,  (35) 

where  it  is  understood  that  y  *  yts)  is  a  function  of  s.  The  probability 
that  a  contact  will  occur  by  search  time  s  is 

Pc(s,y)  =  1  -  Q1(s,y)  QF(s,y) 

We  note  that  P^Cs.y)  is  the  probability  distribution  function  of  s^,  the 
time  of  first  contact.  The  rate  of  making  contact  at  search  time  s  is 

Pc  *  df  Pc<s’>'(s))- 

We  can  write  P'  in  the  form 
c 

Pc  =  Q1  PF  +  QF  P1  (36) 

where 

P1  -  1  '  V  PF  =  1  -  QF 

and  the  prime  indicates  total  derivative  with  respect  to  s.  The  two  terms 
in  the  righthand  member  of  equation  (36)  are  the  contact  rates  on  the 
false  target  and  the  target  respectively.  If  the  first  contact  occurs  at 
search  time  s^,  the  conditional  probability  that  the  contact  is  made  on 
the  false  target  is  q^(s^,y (s^)) ,  where 

q1(s,y(s))  -  Q1(s,y(s))  Pj(s,y(s))/P^<sfy(s)) 
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The  time  T^(s^,  in  equation  (32)  will  be  written  in  the  form 
y  (s^) ) .  Then 

^(s.y)  -  s  +  Pp(s ,y)  R  (s,y)/P^(s,y) , 

where 

R(s,y)  -  f1e“y(2y  -  s  +  4  +  lntf"1-!))  +  2(1  -  f^e"8*7  (37) 

The  mean  value  of  T^s^y^))  over  sx  is 

00  00 

Tl^  “  /  T  (s,y(s))P'(s,y(s))ds  «  J*  F(s,y(s) ,y' (s))ds  (38) 

0  0 

where 

F(s,y,y')  =  G(a,y)  I-  y'  H(s,y)  (39) 

and 

G(s,y)  -  QF(s,y)[Q1(s,y)  +  R(s,y)] 

H(s,y)  -  -QF(s,y)  R(s,y) 

We  now  find  y(s)  to  minimize  T^(y)  in  (38).  With  an  integrand  (39)  that  is 
linear  in  y'  the  problem  is  easy  to  solve  by  methods  from  the  Calculus  of 
Variations.  The  necessary  conditions  of  Legendre  and  Weierstrass  are  satis¬ 
fied.  Euler's  necessary  condition  for  an  extremum, 

_d  /  9F\  9F  , 
ds  \9y'y“  3y 

reduces  to  the  condition 


9G  _  9H 
9y  9s 


with  the  integrand  F  in  (39)  that  is  linear  in  y'.  This  equation  reduces 
to  the  equation 


Q 


1 


9Q1  +  9R  £R 
9y  9y  9s 


0 


(40) 
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with  the  simple  form  for  Q  in  equation  (35).  When  the  equations  for 

F 

and  R  in  (34)  and  (37)  are  used,  equation  (40)  becomes 


2(f’1-l)  e2y"8  «  2y  -  s  +  3  +  ln^1-!)  , 


which  becomes 


2  e  ■  u  +  3 


with  the  change  of  function, 

u  -  2y  -  s  +  ln(f^-l)  (42 

There  are  two  solutions  of  equation  (41).  Let  u^  be  the  positive  solution, 
which  is  approximately  u^  -  0.583.  The  corresponding  solution  of  equation 
(42)  is 

yl(8)  »  y  (s  +  Uj  -  ln(f^-l) )  (43! 

We  now  can  show  that  the  solution  y^(s)  in  equation  (43)  minimizes  the 
integral  T^(y)  in  equation  (38)  by  showing  that  the  second  variation  of 
the  integral  is  non-negative,  which  is  a  fora  of  Jacobi's  condition.  The 
second  variation  I"  of  the  integral  is 

I"  -  J  (f  n2  +  2  f  t  nn'  +  F  ,  ,n,2)ds, 

J0  yy  yy  y  y 

where  n  -  n(s)  is  an  arbitrary  variation  from  y1(s)  that  vanishes  at  the 
end  points.  With  the  F  functional  in  equation  (39)  1"  becomes 
00 

I"  -  4  J  [(l-f1)(3-2y')  e2y-2s  p2-^’8  +  2(l-f1)e2y_2s)nn'  ]ds 
Integrating  by  parts  and  using  the  property  that  n(s)  vanishes  at  0  and  »>, 


we  have 


f  (l-y')e2y~2s  n2  ds  -  /  e2y*2s  nn'  ds 
J  *  (\ 


When  we  use  this  equation  to  eliminate  y',  the  second  variation  becomes 


co 

I"  -  4  J*  ((l-f1)e2y  2s  n  -  f^e  8  nn'lds 
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Again,  integrating  e  snn'  by  parts,  we  obtain 

I"  -  2  / Ud-f^e27"28  -  tl  e‘S]  n2ds 

For  y  ■  y^(s)  in  equation  (43)  I"  reduces  to 

oo 

I"  -  2f.(u  +  2)  f  e-8  n2  ds, 

1  1  Jo 

for  which  I"  0  for  all  n(s),  with  equality  only  for  trivial  n(s). 

With  the  negative  root  u2  of  equation  (4l),  I"  is  negative,  since  u^  <  -2. 
The  corresponding  function  y2(s)  maximizes  the  integral  (38).  Of  course, 
it  does  not  maximize  the  expected  time  to  detection,  since  the  minimum 
time  T2  is  used  in  finding  T^(y). 

The  function  y  (s)  in  equation  (43)  is  the  unrestricted  minimizing  function. 
^  * 

We  obtain  the  optimal  function  y  (s)  by  imposing  the  restrictions 

£ 

0  <_  y  (s)  <_  s.  The  optimal  solution  depends  on  the  value  of  f^.  If 

f1  <  (1  +  e1!)'1  i  0.358, 

0,  0  <  s  £  -  u-  +  In  (f^-1) 

*  11 

y  = 

|(s  +  ux  -  lnd"1-!)),  s  >  -  ux  +  In  (f^-1) 

U1  -1 

If  fx  >  (1  +  e  X)  \ 

s  ,  0  <  s  <_  u  -  In  (f^-l) 

*  1  1 

y(s  +  ux  -  lnU^-l)),  s  >  Uj  -  In  (f^^-l) 

U1  -1 

We  note  that  f2  ■  (1  +  e  )  ,  which  is  less  than  0.5  since  u^  >  0.  This 

outcome  had  been  anticipated  above  in  obtaining  the  solution  in  the  second 
stage.  Also,  we  note  that  s^  ■  u^. 
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The  complete  solution  is  the  following: 
First  Stage 

For  0  <  s  <_  |  -  ln(f^-l)  |  , 

0  ,  for  x  in  I, 


1  -1 

s  ,  for  x  in  II,  if  f^  <  (1  +  e  ) 


s  ,  for  x  in  I, 


0  ,  for  x  in  II,  if  f  >  (1  +  e  x) 


1*-1 


For  | Uj 


-  ln(fx  -1)  |  <  s  <  sx 


P1  " 


•|-(s  +  u^  -  lnCf^1-!))  ,  for  x  in  I 


■|-(8  -  u^  +  ln(f^-l))  ,  for  x  in  II 

*  1 


i  i  _i  *  1 

If  fj.  ■  (1  +  e  )  ,  the  solution  is  simply  y^  ■  for  all  x. 

Second  Stage  .  „  , 

- 1  0  ,  for  x  in  I 

s  ,  for  x  in  II 


For  0  <  s  £  u^  ,  y^  ■ 


For  s  >  u^. 


^■(s  -  u^,  for  x  in  I 


y(s  +  u^),  for  x  in  II 


the  second  stage  the  total  search  time  is  s.  +  s  and  the  total  effort 


In 

& 

density  function  is  y^(s^)  +  U2(s). 


We  start  searching  in  region  II  when  f^  is  less  than  the  critical  value, 
0.358,  and  in  region  I  when  f^  is  greater  than  the  critical  value.  The 
critical  value  has  been  changed  from  0.5  with  no  false  targets  to  0.358 
by  one  false  target  in  region  II. 
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We  can  use  the  above  method  to  solve  other  two-cell  problems.  We  have 
performed  the  essential  part  of  the  analysis  for  the  cases  in  which  there 
are  0  and  2  false  targets  in  regions  1  and  II,  and  1  false  target  in  each 
region. 

With  this  background,  we  have  attempted  to  solve  the  two-cell  problem  in 
which  there  is  a  known  number  n  of  identically  distributed  false  targets 
with  the  common  density  function:  g(x)  =  for  x  in  I,  g(x)  =  1  -  g 
for  x  in  II.  We  have  written  the  solution  for  the  (n+1)  stage,  the 
n*^  stage,  and  the  essential  part  of  the  (n-l)St  stage.  The  general 
form  of  the  solution  is  the  same  as  that  obtained  in  the  example  above, 
with  some  complications.  Thus,  in  the  n^  stage  we  get  an  equation  for 
y^(s)  of  the  same  form  as  that  for  y^(s)  in  equation  (43),  but  u^  (now  u^) 
is  a  root  of  the  equation 

f^l  -  gl)eU(2eU  -  3  -  u)  =  g]U  -  f  J  (1  -  2eU) , 

which  reduces  to  equation  (41)  when  g^  =  0,  as  in  the  example.  It  ap¬ 
pears  to  be  possible  to  write  out  the  complete  solution  for  this  case. 

The  solution  will  have  the  simple  form  of  the  solution  in  the  example; 
that  is,  we  search  in  one  region  exclusively  or  we  divide  the  effort 
evenly  between  the  two  regions;  no  other  division  of  the  effort  is  ad¬ 
mitted  in  the  optimal  solution. 

If  the  number  of  false  targets  is  not  known  and  the  distribution  is  known 
and  finite,  the  solution  becomes  more  complicated.  We  have  examined  the 
case  in  which  pQ  i  0,  p.^  i  0,  Pi  =  0,  i  >  2.  Again,  the  solution  has  the 
general  form  described  above.  It  appears  to  be  possible  to  write  out  the 
complete  solution  for  the  two-cell  problem  with  a  finite  distribution. 
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